Goto

Collaborating Authors

 simple explanation


Reviews: PAC-Bayes Un-Expected Bernstein Inequality

Neural Information Processing Systems

The paper introduces three exciting ideas to the area of PAC-Bayesian analysis: (1) a new way of using "half-samples" to construct informed priors; (2) offsetting (biasing) the loss estimate by the loss of a reference hypothesis h_* to achieve "fast convergence rates" under Bernstein condition [even when the loss itself is bounded away from zero]; (3) a new form of Empirical Bernstein inequality, which is combined with PAC-Bayes to exploit low variance [the need in a new inequality and its advantages are not well explained]. The authors compare a bound based on combination of the three ideas with PAC-Bayes bound of Maurer (2004) and some other PAC-Bayes bounds, demonstrating superiority of the new approach. While the work is really exciting, the authors fail to clearly separate between the three major contributions. It is not shown how much each of the three novelties contribute to the success of the method. Biasing and informed priors can be easily combined with the bound of Tolstikhin & Seldin (2013) [TS] and this comparison should be added.]


Hidden meaning behind the pear emoji that THOUSANDS of people are putting in their Instagram bios

Daily Mail - Science & tech

If you use Instagram, it's likely you've spotted a few strange changes to some of your friends' bios over the last few weeks. Thousands of users have added a pear emoji to the description on their profile - and there's a simple explanation as to why. The emoji is a new way for singletons to quietly indicate their relationship status. The idea is the brainchild of Pear - a dating concept that describes itself as'the world's biggest social experiment.' Here's everything you need to know, including what the emoji means and how you can use it in your profile.


A Simple Explanation for the Phase Transition in Large Language Models with List Decoding

Chang, Cheng-Shang

arXiv.org Machine Learning

Various recent experimental results show that large language models (LLM) exhibit emergent abilities that are not present in small models. System performance is greatly improved after passing a certain critical threshold of scale. In this letter, we provide a simple explanation for such a phase transition phenomenon. For this, we model an LLM as a sequence-to-sequence random function. Instead of using instant generation at each step, we use a list decoder that keeps a list of candidate sequences at each step and defers the generation of the output sequence at the end. We show that there is a critical threshold such that the expected number of erroneous candidate sequences remains bounded when an LLM is below the threshold, and it grows exponentially when an LLM is above the threshold. Such a threshold is related to the basic reproduction number in a contagious disease.


A simple explanation for Sentence Segmentation and implementation

#artificialintelligence

It is a property that divides sentences according to their context, in each sentence according to its beginning, as well as the context under which it falls. This method is done by choosing one of the two methods: Is there a clear sign in the sentence, such as? Oh! or, It is also done by using an unclear mark such as the period (.), which may have several other uses, such as using it when abbreviating dr. Or so the ml is used to know whether this point is for the end of the sentence or is used to express another purpose. Also, an algorithm can be made manually that knows the end of the sentence.


A Simple Explanation of Causal Inference in Python

#artificialintelligence

There have been more deaths caused by the vaccine than the disease! So should the vaccine programme be cancelled to save lives? To solve that we need to ask the question "What would have happened if we had not run the vaccine programme?". That is a counter-factual question i.e. it is asking us to imagine a different world where we made a key choice differently and to find out what impact that would have had. I will tackle counter-factuals in detail in a future article but for now it is enough to say that the counter-factual makes this a causal inference model that is not well suited to machine learning techniques because it is ab out causation and not correlation.


How AI Works -- A Simple Explanation

#artificialintelligence

If you've found yourself perplexed by the question of what AI is, you are likely to be even more confounded by the question of how AI works. A very deep and complex topic, my aim is to provide the key principles for non-technical stakeholders. From the previous article and a cursory knowledge of AI, we know that AI can be applied in a variety of different ways and used to perform different types of tasks. AI is both a set of tools and the toolbox and we must ensure we select the relevant tool for the relevant task. Whilst the context of its application may vary, as do the tools and data used to generate the desired outcome, there is a method that is relatively consistent across all applications.


Simple Explanation to Machine Learning Ensemble concept

#artificialintelligence

I have been always a fan of using analogies and learning examples instead of complicated statistics and math functions in order to understand a concept in Machine learning. That's being said let's look at this situation. You just bought a new football club. Your new football club does not have any players and there are already 3 teams in the league. Team A has conceded 0 goals all seasons thus it is concluded that Team A has the best defense mechanism.


Neural Style Transfer -- A Simple Explanation

#artificialintelligence

Have you ever admired famous artworks like "The Starry Night" of Vincent Van Gogh or "The Great Wave off Kanagawa" of the Japanese artist Katsushika Hokusai, as shown in Figure 1? Do you like art? Do you want to practice art? Do you want to create your own artworks … like the above ones? In reality, however, I and many of us don't have such a talent to approach this artistic level. Despite this fact, we always want to make our pictures or designs as beautiful, artistic as possible. And we rely on innovative tool or software, for example Adobe Photoshop or Adobe Lightroom, etc. to help us to obtain our own artworks.


Machine Learning, Deep Learning, and Artificial Intelligence: a simple explanation

#artificialintelligence

Today we hear about Artificial Intelligence everywhere. At work, when we look for software that can learn autonomously. Yet, when an expert presents us with a new solution equipped with AI, using terms such as Machine Learning, Deep Learning, and neural networks, we start to have doubts about the real understanding of the topic.


How to make AI more ethical

#artificialintelligence

The Transform Technology Summits start October 13th with Low-Code/No Code: Enabling Enterprise Agility. A recent Pew Research study found that a majority of experts and advocates worry AI will continue to focus on optimizing profits and social control and will not likely develop an ethical basis within the next decade. And in an academic study earlier this year, researchers from Cornell and the University of Pennsylvania found that two thirds of the machine learning researchers indicated AI safety should be prioritized more than it is presently. They also found that people are willing to place trust in AI when it is supported by existing international bodies such as the UN or the EU. Some of these worries are based on early AI models that showed unintended biases.